BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on Protein_catabolism events by Approx. Span matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[JULIELab ]     Protein_catabolism        14 (   11)       13 (   11)    78.57    84.62    81.48
[UT+DBCLS ]     Protein_catabolism        14 (    9)       11 (    9)    64.29    81.82    72.00
[CNBMadrid]     Protein_catabolism        14 (   11)       20 (   11)    78.57    55.00    64.71
[VIBGhent ]     Protein_catabolism        14 (    9)       15 (    9)    64.29    60.00    62.07
[ConcordU ]     Protein_catabolism        14 (    9)       16 (    9)    64.29    56.25    60.00
[  NICTA  ]     Protein_catabolism        14 (    6)        7 (    6)    42.86    85.71    57.14
[  UNSW   ]     Protein_catabolism        14 (    7)       11 (    7)    50.00    63.64    56.00
[  UMich  ]     Protein_catabolism        14 (   10)       23 (   10)    71.43    43.48    54.05
[ASU+HU+BU]     Protein_catabolism        14 (    7)       12 (    7)    50.00    58.33    53.85
[ UZurich ]     Protein_catabolism        14 (    8)       16 (    8)    57.14    50.00    53.33
[ UTurku  ]     Protein_catabolism        14 (    6)        9 (    6)    42.86    66.67    52.17
[UAntwerp ]     Protein_catabolism        14 (    9)       21 (    9)    64.29    42.86    51.43
[   Cam   ]     Protein_catabolism        14 (    5)        6 (    5)    35.71    83.33    50.00
[ UNIMAN  ]     Protein_catabolism        14 (    6)       12 (    6)    42.86    50.00    46.15
[ UAveiro ]     Protein_catabolism        14 (    5)        8 (    5)    35.71    62.50    45.45
[ UTokyo  ]     Protein_catabolism        14 (    4)        5 (    4)    28.57    80.00    42.11
[CCP-BTMG ]     Protein_catabolism        14 (    4)        6 (    4)    28.57    66.67    40.00
[ USzeged ]     Protein_catabolism        14 (    6)       17 (    6)    42.86    35.29    38.71
[  PIKB   ]     Protein_catabolism        14 (    4)        7 (    4)    28.57    57.14    38.10
[CIPS-ASU ]     Protein_catabolism        14 (    8)       29 (    8)    57.14    27.59    37.21
[ Team 24 ]     Protein_catabolism        14 (    3)        4 (    3)    21.43    75.00    33.33
[  SCAI   ]     Protein_catabolism        14 (    4)       11 (    4)    28.57    36.36    32.00
[ KoreaU  ]     Protein_catabolism        14 (    1)        3 (    1)     7.14    33.33    11.76
[ Team 09 ]     Protein_catabolism        14 (    0)        0 (    0)     0.00     0.00     0.00

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ]     Protein_catabolism        14 (    9)       11 (    9)    64.29    81.82    72.00
[CNBMadrid]     Protein_catabolism        14 (   11)       20 (   11)    78.57    55.00    64.71
[ASU+HU+BU]     Protein_catabolism        14 (    7)       12 (    7)    50.00    58.33    53.85
[UAntwerp ]     Protein_catabolism        14 (    9)       21 (    9)    64.29    42.86    51.43
[CCP-BTMG ]     Protein_catabolism        14 (    4)        6 (    4)    28.57    66.67    40.00
[ Team 24 ]     Protein_catabolism        14 (    3)        4 (    3)    21.43    75.00    33.33

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------